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Abstract: A brief presentation of basics of the theory of Tehebycheff and 
Markov systems of functions and its applications to extremal problems for 
integrals of such functions is given. The results, as well as all the necessary 
definitions, are stated in most common terms. This work is motivated by 
r'~S ^ specific applications in probability and statistics. A few related questions 

, , are also briefly discussed, including the one on the existence of a Tcheby- 

r^ ■ cheff system on a given topological space. 
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m 

■"sj" ■ The theory of Tchebycheff systems (or, briefly, T-systems) presents powerful 

CO I tools that can be used in various extremal problems in analysis, probability, 

f"~>. ■ and statistics; see e.g. monographs [4, 6] and the extensive bibliography there. 

^D I However, whereas the Carathcodory Principle (as stated below) and the related 

duality principle (see e.g. [6, Theorem 4.1]) have been used extensively in prob- 
ability and statistics (see e.g. [4, Chapters XII and XIII] and [12. 10, 11, 9]), 
there appear to have been very few (if any) such applications of the theory of 
k>( \ T-systems, even though the latter offers significant advantages. Even in [4], I 

- ■ have not found applications in probability or statistics of the T-systems theory 

per se. 

This brief survey was motivated by specific applications in [8] . Here we shall 
present basics of the theory of T-systems and its applications to extremal prob- 
lems for the corresponding generalized moments. The results, as well as all 
the necessary definitions, will be stated in most common terms and thus, it is 
hoped, easy to use; the notions of canonical and principal representations will 
be avoided here. A few related questions will also be briefiy discussed, including 
the one on the existence of a T-system on a given topological space. 
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For a nonnegative integer n, let go, ■ ■ ■ ,gn be (real- valued) continuous func- 
tions on a compact topological space X. Let M denote the set of all (nonnega- 
tive) Borel measures on X. Take any point c = (cq, . . . , c„) G R""*"^ such that 

A/c := (m e Af : / .g; d^ = a for all i e O^nj 7^ 0; (1) 

Consider also the condition that the (generalized) polynomial 

n 

yj Xigi is strictly positive on X, for some (Aq, . . . , A„) e R"+^. (2) 



Caratheodory Principle. (See e.g. [3, 5].) If the topologcal compact space X 
is Hausdorff and (2) holds, then the maximum of J^ <7n+i d/x over all fi G A/c 
is attained at some measure fJ-rnax G Mc with card supp /imax ^ n -|- 1 . 

Here, as usual, card stands for the cardinality and supp/x denotes the support 
set of the measure /i. Note that in [5] it is additionally assumed that go = 1, 
which is used to provide for the weak compactness of Mc. However, the same 
effect is achieved under the more general condition (2). 

Remark 1. The condition that X be compact can oftentimes be circumvented 
by using, for instance, an appropriate compactification, say X, of X if X is (say) 
only locally compact (as, for instance, M'"" is). At that, one may be able to find 
a function h, which is positive and continuous on X and such that the functions 
^, . . . , ^ can be continuously extended from X to X; sometimes one of the gi's 
can play the role of h; or, more generally, h can be constructed as (or based on) 
a polynomial ^g Xigi. Replacing then go, . . . ,gn by the continuous extensions 
of the functions ^, . . . , ^ to X and, correspondingly, replacing the measure /j, 
by the measure v (on X and hence on X) defined by the formula dv = hd/i, 
one will largely reduce the original optimization problem on X to one on the 
compact space X. 

The essential fact is that the upper bound n -f- 1 on the cardinality of the 
support of an extremal measure fi given in the Caratheodory Principle can be 
approximately halved in the presence of the TchebychefF or, especially, Markov 
property. 

Definition 1. The sequence {go, . . . ,gn) of functions is a T-system if the re- 
strictions of these n + 1 functions to any subset of X of cardinality n -I- 1 are 
linearly independent. If, for each k £ 0,n, the initial subsequence {go, ...,gk) 
of the sequence {go, ■ ■ . ,gn) is a T-system. then {go, . ■ . ,gn) is said to be an 
M -system (where M refers to Markov). 

By Haar's theorem, linearly independent functions go, . ■ . ,gn on X form a 
T-systcm on X if and only the problem of best uniform approximation of any 
given continuous function on X by a polynomial ^q Xigi has a unique solution; 
see e.g. [13]. 

Any T-system satisfies the condition (2); see e.g. [6, Theorem H.1.4]. 
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For any n ^ 1 and any topological space X of cardinality ^ n + 1, if there 
exists a T-system (go, • ■ • , ffn) of continuous functions on X, then X is necessarily 
Hausdorff. Indeed, take any distinct xq and xi in X. Let a;2, . . . , x„ be any points 
in X such that xq, . . . ,Xn are distinct. The restrictions of the functions go, . . . , gn 
to the set {xq, . . . ,x„} are linearly independent and hence gi{xo) ^ gi{xi) for 
some i € 0,n. Take now any disjoint open sets Oo and Oi in R containing gi^xo) 
and (7i(a;i), respectively. Then the pre-images g~^{Oo) and 5~^(0i) of Oq and 
Oi under the mapping gi are disjoint open sets in X containing xq and xi, 
respectively. Thus, X is a Hausdorff topological space. 

In connection with Remark 1, it should be noted that, clearly, if (go, • ■ • , 5fc) is 
a T-system or an M-system, then the same is true of the sequence (^, . . . , ^), 
for any positive continuous function h. Note also that, if (go, . . . ,.g„) is a T- 
system on a set X' containing X and such that card(X' \ X) ^ n, then 
(ho, . . . , hn) '■= ^(50, • • • ,5n) is an M-system on X for some linear (necessarily 
nonsingular) transformation A of M"+^; cf. [6, Theorem II.4.1]. 

A T-system (go,- ■ ■ , gn) with n ^ 1 on (the compact topological space) X 
exists only if X is one-dimensional (which will be the case in many applications) . 
More precisely, if for some n ^ 1 there exists a T-system oi n + I functions on 
X, then X must be homeomorphic to a subset of a circle; for X CMJ^ this was 
proved in [7], and for general X in [2] (with an additional restriction) and in 
[16]; a further extension of this result to complex T-systems was given in [14], 
where one can also find yet another proof of the real- valued version. 

In fact, the general case of (real- valued) T-systems can be easily reduced to 
the special case with X C M.^. Indeed, for any natural n consider the mapping 
X !->■ r{x) := 5(0;)/ [[^(a;) II of X into the unit sphere S'" in M"+^, where g{x) := 
{go{x), . . . , gn{x)) and || ■ || is the Euclidean norm. In view of the T-property 
of (5o,---,ffn) and the compactness of X, this mapping is correctly defined 
(since g{x) is nonzero for any x G X), one-to-one, and continuous, and hence 
a homeomorphism of the compact Hausdorff set X onto the image in 5*" of X 
under the mapping r. In the case n = 1, this also proves the mentioned result 
of [7, 2, 16]. Another elementary observation in this regard, presented in [1], is 
that a T-system (go, • ■ • ,ffn) with n ^ I on X may exist only if X does not 
contain a "tripod", that is a set homeomorphic to the set {(s,0) G M^ : |s| < 
l}U{(0,i) €R'^:0<t<l}. 

We shall henceforth consider the case when X ~ [a, 6] for some a and b 
such that —00 < a < 6 < 00. Let {go, . . . ,gn) be a T-system on [a,b]. Let 
det (^^(xj)) denote the determinant of the matrix {jji{xj): i € 0,n, j £ 0, n). 
This determinant is continuous in (xq, . . . ,x„) in the (convex) simplex (say S) 
defined by the inequalities a ^ xq < ■ ■ ■ < Xn ^ b and does not vanish anywhere 
on E. So, det (^gi{xj)^ is constant in sign on E. 

Definition 2. The sequence {go, . . . ,<;„) is said to be a T+-system on [a,b] if 
det (<7i(a;j))g > for all (a;o, . . . , x„) £ E. If (go, • ■ • , fffc) is a T+-system on [a, b] 
for each A: G 0, n, then the sequence (go, ■ • ■ , ffn) is said to be an M^-system on 
[a, 6]. 

Clearly, if {go, . . . ,gn) is a T-system on [a, 6], then either (go,...,g„) or 
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(ffo, ■ • • ,.9n-i, -9n) is a T+-systeni on [a, b]. Similarly, if (go, • ■ -^gn) is an M- 
system on [a,h] then, for some sequence (so,...,s„) G { — 1,1}"+^ of signs, 
[sqQq . . . , s„5„) is an M+-system on [a, 6]. 

In the case when the functions g^, . . . ,gn are n times differentiable at a point 
X G {a,b), consider also the Wronskians 

<(x):=det(gp'(x));, 

where fc G 0, n and g^ is the jth derivative of g^, with g^^ := g,;; in particular, 
<(a:)=,go(x). 

Proposition 1. Suppose that the functions go, ■ ■ ■ ,gn o,fe (still continuous on 
[a, b] and) n times dijjerentiable on (a, b). Then, for the sequence (go, ■ ■ ■ ,9n) to 
be an M^-system on [a, b], it is necessary that Wq ^ on (a, b) for all fc G 0, n, 
and it is sufficient that Uq > on [a, b] and Wq > on (a, b) for all fc G 1, n. 

Thus, verifying the Af+-propcrty largely reduces to checking the positivity of 
several functions of only one variable. 

A special case of Proposition 1 (with n = 1 and 50 = 1) is the following well- 
known fact: if a function gi is continuous on [a, b] and has a positive derivative 
on {a,b), then gi is (strictly) increasing on [a, 6]; vice versa, if 51 is increasing 
on [a, b], then the derivative of gi (if exists) must be nonnegative on (a, b). 

As in this special case, the proof of Proposition 1 in general can be based on 
the mean- value theorem; cf. e.g. [4, Theorem 1.1 of Chapter XI], which states 
that the requirement for Wq to be strictly positive on the closed interval [a, b] 
for all fc G 0, n is equivalent to a condition somewhat stronger than being an 
M+-system on [a,b]; in connection with this, one may also want to look at [6, 
Theorem IV. 5. 2]. Note that, in the applications to the proofs of [8, Lemmas 2.2 
and 2.3], the relevant Wronskians vanish at the left endpoint of the interval. 

The proof of Proposition 1 can be obtained by induction on n using the 
recursive formulas for the determinants det (^^(xj)) and Wq as displayed right 
above [4, (5.5) in Chapter VIII] and in [4, (5.6) in Chapter VIII], where we use 
gi in place of ipi . 

Proposition 2. Suppose that [go, . . . , gn+i) is an Mj^-system on [a, b] or, more 
generally, each of the sequences {go, . . . , gn) and [go, . . . ,.g„+i) is a Tj^-system 
on [a, 6]. Suppose also that condition (1) holds. Let m := L'^^2^J- Then one has 
the following. 

(I) The maximum (respectively, the minimum) of J .g„+i d^ over all ^ G M^ 
is attained at a unique measure fJ-max (respectively, fJ-min) 'in Mc. More- 
over, the measures /^max imd fimin do not depend on the choice of gn+i, 
as long as .g„+i is such that (50, • ■ • ,5n+i) is a T-^--system on [a, b]. 
(II) There exist subsets Xmax cind Xmin of [a, b] such that X^ax ^ supp/i,nax, 

-'^min 2 SUpp//,nin, and 

(a) if n ~ 2m then cardXmax = cardXmin — rn + 1, Xmax 3 b, and 
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(b) if n ^ 2m — 1 then card Xmax — m + l, card Xmi 
{a,b}. 

Whereas the maximizer fimux and the minimizer /imin are each unique in Mc 
for each given c with Mc 7^ 0, in particular apphcations such as the ones in [8], 
one may want to allow the vector c to vary, and then the measures ^max and 
Mmin will vary with c, and thus the corresponding subsets Xmax and Xmin of [a, b] 
may vary. Then the number of real variables needed to describe each of the sets 
-'^max and Xmin will bc about ^^, that is, half the number of restrictions on the 
measure /x and also half the upper bound on card supp /Xmax in the Caratheodory 
Principle; here one should also take into account that, as described in part (II) 
of Proposition 2, the sets Xmax and Xmin may have to contain at least one of the 
endpoints a and b of the interval [a, 6], with the corresponding reduction in the 
required number of variables. On the other hand, the Caratheodory Principle 
holds for more general systems of functions, defined on a set X of a much more 
general class. 

To illustrate Proposition 2, one may consider the simplest two special cases 
when the conditions of the proposition hold and its conclusion is obvious: 

(i) n = 0, goix) = 1, gi is increasing on [a, &], and cq ^ 0; then supp/i,nax Q 
{b} and supp^min ^ {a}; in fact, ^^ax = coi5& and ^min = coSa] here and 
in what follows, S^ denotes the Dirac probability measure at point x. 

(ii) n = I, go{x) = 1, gi{x) = x, 32 is strictly convex on [a, 6], Cq ^ 0, and 
ci e [cQa,cob]; then supp/i,„ax C {a, &} and card supp /Xmin ^ 1; in fact, 
A^max = ""^I^^ Sa + ^^Ef^f^fc, and ^„iin = caSc^/cg if Co > and ^imin = if 
co = 0. 

These examples also show that the T-property of systems of functions can be 
considered as generalized monotonicity/convexity; see e.g. [15] and bibliography 
there. 

Proof of Proposition 2. Consider two cases, depending on whether c is strictly 
or singularly positive; in equivalent geometric terms, this means, respectively, 
that c belongs to the interior or the boundary of the smallest closed convex 
cone containing the subset {{go{x) , . . . , gn{x)) : x £ [a,b]} of R"+^ [6, Theo- 
rem IV.6.1]. 

In the first case, when c is strictly positive, both statements of Proposition 2 
follow by [6, Theorem IV. 1.1]; at that, one should let X^ax = supp^max and 
^min = supp/Xiiiin- (The Condition that c be strictly positive appears to be miss- 
ing in the statement of the latter theorem; cf. [4, Theorem 1.1 of Chapter l.lj.) 

In the other case, when c is singularly positive, use [6, Theorem III.4.1], which 
states that in this case the set Mc consists of a single measure (say ^,), and its 
support set X, := supp /Lt* is of an index ^ n; that is, £- +2£ + £+ ^ n, where 
i- , i, and £+ stand for the cardinalities of the intersections of X* with the sets 
{a}, (a, b), and {b}. It remains to show that this condition on the index of X* 
implies that there exist subsets Xmax and Xmin of [a, b] satisfying the conditions 
(Ila) and (lib) of Proposition 2 and such that X^ax H Xmin 2 X^,. 



imsart-generlc ver. 2009/05/21 file: arxiv.tex date: July 19, 2011 



losif Pinelis/T -systems review 6 

If n = 2m then card(X* n (a, 6) ) = £ sC ^ 2m-^_-f+ j ^ ^ 2m_^ j ^ ^ _ £_ . gQ^ 
card(X*U{6}) ^ £_ + (m-^_) + l = m+1. Adding now to the set X* U {6} any 
m+1 — card(X*U{5}) pomts of the complement of X*U{&} to [a, 6], one obtains 
a subset Xmax of [a, b] such that X^ax 2 X*, -^max 9 &, and cardX^ax = m + 1. 
Similarly, there exists a subset Xmin of [a, fe] such that X-adn 3 -'^*, -'^min 9 a, 
and cardXmin = m + 1. 

If n = 2r77 — 1 then card(X* n (a, 6)) = t ^ [ "^ ~ ~~ + J ^ m — 1 and hence 
card(X* U {a, 6}) ^ 1 + (m — 1) + 1 = m + 1. So, there exists a subset X^^^x of 
[a, 6] such that Xmax ^ -'^*, -''^max ^ {o-T^}, and cardXmax = 77?.+ 1. One also 
has cardX, = ^_ + £ + £+ s^ ^ 2m-i+£_+£+ j ^ \J^\^ ^ ^_ go, there exists a 
subset X,nin of [a, 5] such that X^i^ D X* and cardXmin — in. D 
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